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Abstract 

We study a class of heterogeneous agent-based models which are based on a basic set 
of principles, and the most fundamental operations of an economic system: trade and 
product transformations. A basic guiding principle is scale invariance, which means 
that the dynamics of the economy should not depend on the units used to measure the 
different products. We develop the idea of a "near-equilibrium" expansion which allow 
us to study the dynamics of fluctuations around economic equilibrium. This is similar 
to the familiar "perturbation theory" studied in many areas of physics. We study some 
simple models of both centralized and decentralized markets. We show the relaxation 
to equilibrium when appropriate. More interestingly, we study a simple model of a 
decentralized market that shows a spontaneous transition into a monetary phase. We 
use mean field theory analysis to provide a statistical interpretation of the monetary 
phase. Furthermore, we show that such phase can be dynamically unstable. Finally, 
we study some simple centralized financial markets, one of which shows a speculative 
bubble and a crash. 

1 Introduction 

It is fair to say that the global economic system is one of the most complex structures 
known in the biosphere. Compared to physics, economics differs in the important fact 
that the basic constituents, or "particles", are already quite complex: human beings. 
Moreover, they act on greed and according to expectations about how the future will 
unfold. 

How can one even start to understand such a system when we need to model people's 
behaviors? One key revolution came from the concepts of game and decision theory 
In particular, the utility maximization theorem of Morgester and Von Neumann 



provided a simple framework in which to model rational decision makers. This lead to 
the concept of Nash equilibrium, which is basically the core of neoclassical economic 
theory [U [5] . 

Nevertheless, the economy is not composed of one or two players, but millions of 
them. In order to make progress, economist have made many extra assumptions such 
as the homogeneity of players, perfect information knowledge, unbounded rationality, 
etc. In particular, the concept of "rational expectations" [3j lead to much progress as it 
provides closure to the economic equations. The above concepts usually go under the 
name of "equilibrium theory" . Under these assumptions it is possible to prove beautiful 
theorems regarding the existence of Nash equilibria for the whole economy [6] . However, 
equilibrium theory is not a dynamical theory. Therefore, issues of stability and phase 
transitions cannot be addressed within this framework. 

Furthermore, there is an on-going debate on the validity of the assumptions of equi- 
librium theory [7]. First, there is the critique to the assumption of the homogeneity 
of agents. This seems specially concerning in macoeconomic theory, where one usually 
resorts to the "representative agent model" Quoting Conlisk [8]: "We model Robin- 
son Crusoe and pretend he's a 7 trillion dollar economy" . In respond to this critique, 
there has been an increasing number of heterogeneous agent models in the literature 
(see e.g. [9J [TUl Ell El])- In fact, it is usually claimed that some of the most salient 
stylized facts of financial time series are due to the heterogeneity of agents' strategies. 

Another critique concerns the assumption of unbounded rationality. More precisely, 
it is usually assumed in most economic theory that agents have perfect knowledge about 
the economy and the other agents' strategies (this is necessary in order to prove Nash 
equilibrium). Moreover, they need to maximize their expected utilities with respect to 
all possible strategies. There is a heated debate about the validity of these assumptions, 
and their effect on the dynamics of the economy |13|, EU [T5| [T6] . Models that relax 
some of these assumptions are usually called under the name of "bounded rationality" . 
One of the main critiques to the unbounded rationality paradigm, is the difficult and 
costly optimization problems that agents are supposed to do [BJ . 

In this paper we want to separate the concept of equilibrium from the assumptions 
of agents' rationality. It is often the case that both concepts get tangled under the 
same name. Here we say that the economy is in equilibrium if, given the constraints 
on the system, agents' expected utilities are maximized. In other words, agents are as 
happy as they get (within their constraints). We will assume the minimal rationality 
that is required by the Savage- Von-Neumann-Morgenstern axioms of decision theory, 
which lead to the utility maximization theorem pQ. 

The usual approach to go beyond equilibrium theory is to use computational agent 
based models |17j . Nevertheless, once we break the assumptions of equilibrium theory, 
one encounters almost an infinite set of possible models. Are there any basic principles 
in which a semi-realistic economic model should be based on? 
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In this paper we introduce a class of economic agent-based models which are built 
around some basic set of principles and the most fundamental operations of an eco- 
nomic system: trade and transformations. More precisely, there are a finite number of 
products in the economy which the agents can trade or transform into other products. 
The amount of each product in the economy can be measured in any units the agents 
want to use. One of the basic principles is that the dynamics of the economy should 
be invariant under a change of product measure. This principle is analogous to the 
"gauge symmetries" found in physical system^. We call this gauge symmetry scale 
invarianc^. We will show that such a symmetry principle gives rise to very useful 
restrictions on the possible dynamics. 

Another important guiding principle is bounded rationality. Our agents are bound- 
edly rational in that they do not need to know all the information of the economy in 
order to make a decision. Moreover, they only have a finite set of possible operations 
that they can do at every time step. They choose to do the operations which give them 
maximum satisfaction. 

Another important principle is that prices are relational and they simply describe 
the relative flux of products between two or more agents. Such fluxes do not have to 
be the same among all agents. Therefore, not all agents have to agree on a "price". 
Related to this fact, we assume that agents possess a "what-by-what" matrix which 
represent the agents' opinion on the exchange rate between the different products in 
the economy. These represent part of the information that agents have about the 
economy. This type of economic modeling is based in the ideas of Brown et. al |19j . 
The framework presented here allows to simulate heterogeneous agents expectations. 

We develop the idea of a "near-equilibrium" state, where the agents' expected 
utility is close to being maximal. In this way we are able to derive approximate "flow" 
equations which describe how many products are exchanged or transformed in any 
of the possible economic operations. The equations are written for general expected 
utilities, and they allow for fast numerical implementation. Moreover, our semi-analytic 
approach allow us to apply mean-field theory to certain agent-based models. We argue 
that the concept of a "near-equilibrium" state is similar to the familiar "perturbation 
theory" of Quantum Field Theory, in which we expand the theory around a particular 
vacuum. This provides a constructive way to study fluctuations around an economic 
equilibrium. 

We then present various numerical simulations of particular market models. We 
study both decentralized and centralized markets. One of the interesting questions 

■"■The models that we will study turn out to have an extra "accidental" gauge symmetry which we discuss 
below. 

2 The idea that gauge theories might have applications in economics was introduced to me by Lee Smolin 
[18] . Nevertheless, this idea has been considered before by Ilinsky 20J, Malaney and Weinstein [21] . which 
have also been influential in Smolin's ideas. 
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we address is the emergence of (commodity) money. We study a class of decentral- 
ized markets that show a spontaneous transition into a monetary economy. In other 
words, agents collectively trade using a common product as a "currency". We use a 
mean field theory analysis to show that such transition has a purely statistical origin. 
Furthermore, we show that in some cases such monetary phase can be dynamically 
unstable. 

We also give simple examples of centralized financial markets. In one of these 
models, we include agents' speculations about the future price of the products, which 
leads to a bubble and a crash. 

The organization of the paper is as follows. In section 2, we introduce a list of basic 
principles that we use as a guidance to build our class of agent-based models. In section 
3, we elaborate on the allowed form of the utility functions. In section 4 we introduce 
the idea of a near-equilibrium state, and derive a set of propositions which give us 
the flow equations used in the numerical algorithms. We also make an analogy with 
fluid dynamics. In section 5 we present numerical simulations of decentralized markets. 
The monetary phase is studied in section 5.4. In section 6 we present simulations of 
centralized markets. In section 7 we conclude. 

2 A Minimal Economic System 

In this section we present the basic properties and assumptions of the "minimal" eco- 
nomic system we wish to study. Some of the statement that we will make are very 
generic and need to be refined in order to construct particular models. This will be 
done in the next sections. 

• Agents and Products: We will consider a fixed number of agents N, which we 
label by Greek letters a, [3 = 1,2, N '. The set of all such agents is denoted by 
A, and we will use the notation a G A to refer to some generic agent a in the set 
A. There will be P different kinds of products which we label with Latin letters, 
i, j = 1,2, ... ,P. The set of all kinds of products is denoted by V. By abuse of 
notation, we will sometimes refer to an arbitrary product by the latin letter itself, 
e.g. ieP. 

• Time: We assume that the economy evolves in integer time steps. 

• Inventories and Scale Invariance: Every agent has an inventory of products, with 
quantity n l a of product i. Sometimes we will write n a = (n* , n 2 a , . . .). Agents are 
free to measure each product in arbitrary units. For example, product 1 might 
be measured in liters, and product 2 in pounds. In order to make a trade (see 
below) the two agents must agree on a unit of measure. Therefore, for simplicity 
we assume that all agents agree on the same units of measure for each product. 
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Nevertheless, we assume that the dynamics of the economy is invariant under 
changes of units for all agents. Under such change, the inventories transform as, 

< -» 0V Q , (j? e M+ , Ma G A . (1) 

We say that the transformation ([T]) is a "gauge" symmetry. We call this symmetry 
scale invariancq^. 

• State Space: The state of the economy at any point in time is given by the set 
ifi = {n l a \i € V, a € A}. Let H the set of all such possible states. We see that for 
fixed agent and product number, and if we do not allow agents to have negative 
amount of products, 

H (R+) PxN . (2) 

• Agents' Rationality: We assume that agents have beliefs about how the future 
will unfold. Different agent can have different beliefs and future time frames in 
mind. We will denote the belief of agent a by I a . By abuse of notation we 
will sometimes call such belief "information" . Nevertheless, we should stress that 
such information might be biased or might not be based on a good model of 
Nature. Furthermore, agents are not assumed to have full knowledge of the state 
of the economy and other agents' beliefs. Therefore, we do not assume rational 
expectations. 

We assume, however, that agents make rational decisions given the information 
I a . In other words, we assume that agents' decisions satisfy the Savage- Von- 
Neumann-Morgenstern axioms of decision theory pp. Then, by the Utility Maxi- 
mization Theorem, it follows that such agents must carry an index of satisfaction 
Q , a € A. The index of satisfaction is a map, 

U a : n a x I a — > R . (3) 

Agents always seek to maximize Cl a . We assume the following properties of the 
index of satisfaction, 

di£l a > , dfn a < , V i G V (4) 

where d{ = d/dn l a . 

The index of satisfaction is given in terms of the agents' utility U a as, 

n a = E[U a \l a ] . (5) 

where E[-|T Q ] denotes the future expectation given the information Z a . The utility 
also satisfies the properties (HJ). 

3 In this paper we only study the case of time-independent scale invariance. That is, <j> 1 in Eq. {l} is a 
constant in time. The more general case of a time dependent scale invariance will be studied elsewhere. 
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• What-by- What Matrices: At any point in time, some agents might have an opinion 
on what each product of their inventory is worth in units of another productQ. 
That is, they carry an exchange rate matrix which we call "what-by- what matrix" 
(w-w matrix for short). The entries of such matrix are denoted by (Af Q )*-. Note 
that this matrix is part of the beliefs of the agent, and so by abuse of notation 
we could say that M a £ I a . Moreover, agents not only have an idea of what 
M a should be today but what it should be in the future based, perhaps, in some 
previous experience. 

Let V a be the set of products for which agent a has an entry in his/her w-w 
matrix. Rationality of the agent requires that the w-w matrix obeys the reciprocal 
relation, 

(M a )) = -±-, Vi,jeV a , (6) 

and the transitivity conditions, 

(M a Yj = (M a y k (M a ) k j , Vi,j,keV a . (7) 

We say that a w-w matrix that obeys the conditions © and ([7|) is consistent. 
Under the gauge transformation ([1]), the w-w matrix transforms as, 

(M a y 3 tfiM^ifP)- 1 . (8) 

• Scale Invariance and Utility: Given the structures given so far, we note that all 
tensors must be constructed out of the inventories n l Q and the w-w matrices. More- 
over, scale invariance dictates their transformation properties with respect to ([T]). 
For example, a tensor of the form TV must transform as TV — > <f>* (fi 3 (</> fc ) _1 TY . 
Therefore, one cannot have a combination such as n\ + n„, since n\ and n 2 a are 
measured in different units. One can have, however, T 1 = n] x + (M a ) 2 n a- ^ is 
easy to see that this will transform as T 1 — > c/> 1 T 1 under (JTj) . 

The form of the utility function is also restricted by scale invariance. First, let's 
suppose that U a has a fixed scale dependence with respect to the transformations 
([!]). Then, consider the difference in happiness between an allocation n' a and n a : 

Att a = tt a (n' a ) - O a (4) • (9) 

This is certainly a physically meaningful quantity which allows the agent to de- 
termine if n' a is more desirable than n a . Doing the transformation (TjQ), it follows 
that the difference in happiness for the same physical allocations n' a and ri a , will 
depend on the units used to measure the products. This does not make any 

As we will discuss in the next section, not all agents necesarily have such an opinion. Moreover, some 
agents might have a w-w matrix with entries for only a particular subset of the products that he/she possesses. 
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sensqj. Therefore, to avoid such paradoxes, the utility function much change at 
most by a constant under (Q]). It follows that, 

U a = \ogU a , (10) 

where U a has a fixed scale dependence under (UJ). Scale invariance and the con- 
sistency of the w-w matrix, will imply a bigger gauge symmetry which we will 
discuss in the next section. 

• Trading Network: We fix the "background" market structure which includes the 
trading network and the operations which each agent are allow to make (see 
below). We will consider the case of both a decentralized and centralized market. 

• Economic Operations: An operation O on the market is a map which changes 
agents' inventories. Therefore, it is also a map on the economic state as: 

o-.n^n. (ii) 

We consider two basic kinds of operations: a trade (T) and a transformation or 
metabolism (M). A trade is an exchange of products between two agents. There- 
fore, product number is conserved in this case. A metabolism is a transformation 
of the form, 

i^j. (12) 
Such transformation can be synchronized into more complex ones, e.g. 

(i-fc) + 0'-fc)=* + i-*- ( 13 ) 

We also allow the possibility of a decay (T>) such that 

i - E , (14) 

where E is the energy dissipated in the process. The dissipated energy cannot be 
used by the agents and so it cannot lead to a change in utlity. Nevertheless, the 
fact that decays reduce product number, implies that utility will be reduced by 
a decay process. 

Since economic operations affect the agents' inventory, they also cause a change 
in their satisfaction. Let, 



(on a ) - n a , (15) 

1 a 



for a general operation O. In other words, AoQ a is the change of the agent 
satisfaction due to the operation O with fixed information. 



5 It is like saying: "I would get more happiness if I buy the same amount of gas at the same price but 
using Liters instead of Gallons" . 
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• Dynamics: Given the market structure restrictions, at every time step each agent 
will perform the operation O that give him/her the maximum positive change in 
satisfaction Ao£l a > 0. As we pointed out, decay processes will have ApO a < 0. 
Nevertheless, we assume that such processes are beyond the control of the agents. 

We wish to emphasize that agents will not do inter-temporal optimization prob- 
lems such as the ones considered in discount factor models [4J. Instead, they 
make a decision at every time step regarding which operation maximizes his/her 
satisfaction. 

• Equilibrium: We define equilibrium as a state where there is no operation O such 
that Ae>f2 Q > 0. In other words, all agents are as satisfied as they get given 
the operations they can perform. We will be more explicit about the meaning of 
equilibrium for each one of the economic operations, in section 4. 

• Linear Response Theory and the Near- Equilibrium Expansion: We will derive 
approximate expressions for the action of each of the transformations given that 
agents are close to being satisfied. Thus, A.oft a > 

The properties given above define a broad class of minimal economic systems. How- 
ever, in order to produce particular models we need to be more specific with respect to 
the market structure and the way agents maximize their satisfactions. In this minimal 
model we are considering anonymous agents, and so we do not have contracts and 
credit. The addition of such features will be left for future work. Nevertheless, one can 
introduce interest rates as an exogenous process if desired. 

One of the biggest critiques of the unbounded rationality paradigm is the complexity 
of the optimization processes that agents must do in order to find the equilibrium 
[8]. This also presents a challenge when it comes to numerical simulations: utility 
maximization is a very inefficient algorithm specially if we want to have heterogeneous 
agents expectations. In this paper we solve this problem in two steps. First, we go back 
to the very basic operations of economics which are trade and metabolisms. In this way, 
at every time step agents have only a finite number of operations that they can do. 
This is, in fact, more akin to real life. Second, and more importantly, we will develop 
a "linear response theory" such that satisfaction maximization can be approximated 
in closed form for general utilities, assuming that agents are close to being satisfied. 
That is, agents make decisions following "gradients" of satisfaction. 

This kind of approximation is reminiscent of the familiar "perturbation theory" 
used in particle and other areas of physics. In perturbation theory, one starts with a 
particular vacuum state of the theory. In economic terms, this means first identifying 
a particular equilibrium state (or a family of them). One can then do a systematic 
expansion of small perturbations around such equilibrium. The study of such pertur- 
bations is necessary to gain an understanding of the stability of the vacuum state (or 
economic equilibrium). 
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Another analogy with physics comes from fluid dynamics where one assumes a 
near-equilibrium state at every point in the fluid. Then, one makes an expansion 
in gradients of velocity, temperature and chemical potential that describe the small 
deviations from local equilibrium. From this point of view, and taking into account 
the principles outlined above we can say that: The physics of economics is the study of 
the flow of products through the social network in respond to "gradients" of satisfaction. 
Moreover, prices are relational and given by the ratio of fluxes: e.g. = — An*/An J 
for a trade i j. 

In the next section, we will examine in more detail how scale invariance restricts 
the form of the utility functions. 



3 Scale Invariant Utility Functions 



In physics, gauge symmetries can greatly reduce the number of parameters in a physical 
model. In our scale-invariant formulation of economics, this is also the case. As we 
noted in the previous section, scale invariance severely restricts the form of the utility 
functions that agents can use. In this section we will study some examples of scale 
invariant utility functions and their corresponding index of satisfaction. Nevertheless, 
we stress that the "flow equations" derived in the next section are written for a general 
index of satisfaction. 

An example of a scale invariant utility which we use below is, 



U a = log 



ieV 



(16) 



where < v < 1, and the index j is arbitrary. The exponent v measures how much 
weight the agent puts on the value of his w-w matrix vs. his intrinsic inventory pref- 
erence. For example, for v = 1, the utility is simply the log of the inventory, and so 
the agent is a wealth maximizer. On the other hand, for small v we will see that the 
agents put more attention to their number of products n a . Also note that didjU a ^ 
and so all products are substitutes for this agent. 

The argument of the log is being measured in units of product j. Now suppose 
we made some other choice instead of j. Using the consistency of the w-w matrix one 
finds, 



log 



ieP 



log([(M a )^)+log 



ieV 



(17) 



Therefore, the utility (and hence the index of satisfaction) changes by a constant. 
Since all economic operations involve derivatives of the utility, we see that the choice 
of measure is arbitrary. This is an accidental gauge symmetry. With this utility, every 
product is treated in equal footing, and so that the emergence of money will be a purely 
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dynamical phenomenon. In fact, the monetary phase can be interpreted as a breaking 
of this gauge symmetry. 

An important property of the utility f)16[) is that, for v ^ 0, 1, 

diU a -> oo , as n\ -> . (18) 

This property, along with Eqs. ^ implies that the utility function considered above 
(and hence the index of satisfaction) is convex. Convexity promotes diversification^]. 
For example, an agent will be happier having two kinds of products that only one. To 
see this, consider an agent with product i and j. Furthermore, suppose that it has the 
same net value in each product: n l a = (M a )*-no. Then, 

= log [2«r] > log [( 2 <r] . (19) 

Convexity might seem like a special property of this utility function. However, it 
serves a deeper purpose. A purely wealth maximizer agent will tend to give away all 
his "money" in a single transaction. This is obviously not a realistic human behavior. 
In macroeconomic theory it is often said that the fundamental problem that agents 
face is, precisely, how much to consume and how much to save to consume later [3]. It 
is then assumed that agents do inter-temporal optimization, and thus somehow they 
must know their consumption plan for the rest of their lives! This is a very unrealistic 
assumption. 

In our case, one can avoid facing this problem by considering convex utilities. In this 
way, the agent will not be willing to give up all of any of the products he/she possesses. 
Convexity will also be important in order to prove some of the propositions in the next 
section. Therefore, for the most part of this paper we will only consider convex utility 
functions. Note that we can always take v < 1 in order to have approximate wealth 
maximizer. The main results are insensitive to wether v is exactly one or not. 

Utility functions can also be completely independent on the w-w matrices, e.g. 

C/ a = ^log<. (20) 

In this case didjU a = 0, and so the products are not substitutes. Utility functions can 
also depend on both substitutes and non-substitutes. 

4 Linear Response and Economic Operations 

In this section we will explain in more detail the different kinds of economic operations 
that agents are allowed to do. The operations that we will consider are bartering 
between two agents, an agent making a trade at fixed exchange rate, a production 

6 The fact that convexity implies diversification is an important fact used in modern portfolio theory [22j . 



log + [(MaTjK, 



10 



process and a central agent that sets prices in respond to excess demand. In sections 
5 and 6, we will explain how to use these operations in particular market models. Our 
main goal here is to derive approximate formulas for the flow of products trough the 
economy given that agents are trying to maximize their satisfaction. These formulae 
will be implemented below both in numerical simulations, and in mean-field theory 
analysis. The prevailing theme will be the near-equilibrium expansion. 



4.1 Trading at a fixed Exchange Rate 

In this section we consider an agent that exchanges two products i,j at a fixed rate 
M l - which might be different from his own w-w matrix. More specifically, the trading 
process which we call T\ takes the form, 

7i: n* a -< + An\ < - < - M\Atf . (21) 

Our goal is to find An 1 , given that the agent is trying to maximize his satisfaction. We 
assume that the agent is in a near-equilibrium state, which we define in detail below. 
The proof of the following proposition will require a convex index of satisfaction. 

Proposition 1: In a near- equilibrium state, the amount of product i and j that agent 
a would trade at a fixed rate M 3 i is given by 

fi : An* » J% (ditta - MidjQa^j , An j = —M\An l , (22) 

where 

«C = (d^ a ) 2 ^i^adjnadidjQa - ^(c^) 2 - d^d^) 2 ] . (23) 

Moreover, the gain in satisfaction is given by, 

A Ti n a « hi (dfr a - M{d^ 2 . (24) 
The trade T\ is allowed iff J™ > 0. 

Proof : In order to prove this proposition we need to ask ourselves: what does it mean 
to be in equilibrium? The maximum increase in happiness is a change of inventory An\ 
such that, 



d 

(A Tl n a ] 



dAn 



Ani 



(ft^-M^)! =0, Jg^(^ a 



An' ' (SAn* 



<0, 

An 1 , 

(25) 



where the satisfaction index is now a function of An 1 as, 

n a = + An 1 , < - M\An % ) . (26) 
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We say that the agent is at equilibrium if the solution to Eq. (|25p is An* = 0. 

That a point satisfying the first equation in (|25p exist, follows from the convexity of 
the index of satisfaction. To see this, suppose that dQ a /d(An l ) = (di£l a — M\djQ, a ) < 
0. Then, we can make An* < 0, and keep depleting the amount of product i. However, 
the convexity of the index of satisfaction implies that diVt a will eventually become very 
large and positive. Thus, the sign of dVt a / d{An l ) will be reversed. By continuity, there 
must be a value of An* where {diVt a — M\djVt a ) = 0. Whether this is a minimum or 
maximum must be checked by computing the second derivative w.r.t. An*. 

Therefore, near equilibrium we can expand the gain in satisfaction as, 

A Ti n a « An*' (ditta - M^djUa 



+^(An*) 2 



An* 

d?n a + f m{ ) 2 d*n a - 2Mia i d j n c 



+ ... (27) 

An 8 =0 



The maximization equation reads 

d 



nAn -(A TL n a )=0. (28) 

The linearized solution is given by Eq. (|22p . where we evaluate all quantities at An* = 
0. Note that all indices in Eq. (|22l) reflect their correct tensor transformation properties 
under Eq. (pQ). In writing Eq. (123ft we have used the fact that at equilibrium, the 
inventory of agent a will obey M°- = di$l a / djVt a \ eCL . Therefore, we can approximate, 
M ■ « di{l a /dj£l Q + 0(6), where 5 means a first order deviation from equilibrium. The 
gain in satisfaction can be computed inserting ([22]) in ([27]) . and it is given by Eq. ([21]) . 

We see that Eq. (|22p represent a maximum iff J" > 0. If J™ < the trade will 
not proceed as it will represent a decrease in satisfaction. For most utilities, since 
dfn a < 0, it is easy to satisfy J™ > 0. Nevertheless, we need to check case by case 
since one can have didjQ a < 0. 
□ 

In sections 5 and 6 we will discuss how the agents use the result of Proposition 1 to 
make a decision of wether to trade with T\ or not. In any case, once the agent decides 
that he will trade with the operation Eq. (]22p give us the flow of objects within the 
linear response approximation. This should be compared to the constitutive relations 
of hydrodynamics where the shear tensor has an expansion in gradients of the fluid 
velocity with the first term being the well-known "shear viscosity". In our case, J™ 
plays a similar role as a "transport coefficient" that tell us how the products will flow 
under a gradient of "satisfaction" . Note that this proposition can be easily extended 
to higher orders. 

4.2 Barter 

In a barter economy, two agents must bargain an exchange rate and how much product 
to trade. We will call such operation T2. It is easy to get carried on trying to come 
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up with a complicated algorithm to describe the bargaining process. However, one 
can simply assume that both agents "quickly" converge to an equilibrium. The reader 
might ask: isn't this going back to general equilibrium theory, which is what we are 
trying to avoid? To answer this question, one must consider what are the different time 
scales involved in the problem. How much time does it take for two parties to reach 
a price agreement vs. the time it takes the whole economy to equilibrate (if it does)? 
We can safely assume that two agents can reach an agreement much faster than the 
relaxation time of the whole economy. 

This situation should, again, be compared to the case of fluid dynamics. The fact 
that we can speak of a temperature of a fluid at some point in space, means that we 
are assuming the fluid is in a state of (near) equilibrium locally in space. However, the 
global dynamics of the fluid can be quite complicated (e.g. turbulence). 

After the bargaining process, the inventories of the two agents a and (3 will be 
updated as, 

n i -> n i + > n i -> n o + Ani » n /3 ni p - An * » n i n p - Ani • ( 29 ) 

When both agents are in a near equilibrium state, there is a unique two-agent equilib- 
rium which is summarized in the following proposition: 

Proposition 2 : Near equilibrium, the amount of product i and j that two agents a 
and (5 exchange as a result of a bargaining process (T2 ) is given by, 

An 1 » L iij {diSndjtt - difidjsn) + o(sn 3 ) , (30) 

Anj ~ -^Atf + OiSn 2 ) . (31) 

Ojil 

where 

1*3 = -(djQ) [dfn(djn) 2 + d]n(din) 2 - 20^0^3^ + otfsi 2 )]' 1 + o(5n 2 ) . 

(32) 

and 

n = n a + ftp , sn = n a - n p . (33) 

Moreover, the gain in satisfaction is given by, 

L iij 9 
A T2 !] a » Ar a ty9 ~ {didVLdjVL - dtfldjSn) 2 . (34) 

The trade %, will proceed iff L u i > 0. 

Proof: To prove this proposition we can simply use the fact that at equilibrium, by 
definition, the excess demand will be zero. If agent a and (5 are in a near-equilibrium 
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state, we have already calculated the amount of goods that they require to maximize 
their satisfaction (proposition 1). In terms of i we have, 



A< « J% \diSla - (MJidjSlc) , An} « J$ [d^lp - (M^djSlp) , (35) 

where M* is the equilibrium exchange rate, which is to be determined. 

The condition of zero excess demand is simply An l a + An^ = 0. This determines 
the exchange rate to be, 

(M y - J * diQa + J J®&P ,„ fi v 
Inserting Eq. ([36]) this back into ([35]) gives, 

jiijii 

A < - jg^frim m " d,ns " 9i wl ' <37> 



Since we have been using the near-equilibrium approximation in (|35p . we must be 
consistent with it. Looking at Eq. (|37[) . we notice that if both agents have the same 
preferences, there will be no trade. More precisely, An l a = if di(Sl a — Sin) = and 
dj(Sl a — Qp) = 0. This makes perfect sense: the only reason two agents will ever trade 
is because they have different preferences (or expectations). To be consistent with the 
near-equilibrium approximation, we should assume that the two agents' preferences are 
not very different. To do this, we define, 

n = n a + Hp , ssi = n a - % • (38) 

We now need to expand to leading non-trivial order in (derivatives of) SSI. 
Thus, to leading order, the exchange rate (j36[) gives, 



(M*H~ |g + <D(Stf) . (39) 



Moreover, Eq. (|37j) gives precisely Eq. (|30|) of the proposition. 

The gain in satisfaction for both agents can be calculated from Eq. (|24|) of proposi- 
tion 1. Inserting Eq. (f39|) into ([24]) and respecting the near-equilibrium approximation, 
we get Eq. ([34]) . 
□ 

It is interesting that to the leading approximation, the two-agent equilibrium is 
egalitarian (ASl a = ASlp). One can then, alternatively, prove this proposition starting 
from the assumption that the two-agent equilibrium is egalitarian. For an egalitarian 
equilibrium there is a unique way to decide what to trade: the agents simply trade 
the pair which gives them the best (mutual) satisfaction. If one goes beyond the near- 
equilibrium approximations used above, both agents will not necessarily get the same 
satisfaction. 
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4.3 Metabolisms 

In this section we will consider a transformation or metabolism of the form, 

M : i + j^k. (40) 

Such transformation will be made using the current technology which we encode in a 
production matrix. 

Definition 1: A Production Matrix is the rate into which product i and product j are 
depleted in the conversion i + j — > k. We write 

*? = - p " *? = - p - n,n>o, (4i) 

and we assume that both products i and j must be present at the same time. By 
convention, we will always take the upper index to be one of the input products, and 
the lower index the output product. Thus, note that P l k / 1/-P* in general, as P\ and 
pk re p resen t very different processes. 

Agents will only perform metabolisms that increase their satisfaction. We are now 
ready to calculate how much output is produced in a production process, assuming 
near-equilibrium state. 

Proposition 3 : Near equilibrium and with constant production matrices, the output 
of a metabolic process M. : i + j — > k can be approximated by 

An k « K kk {-d^ a P\ - d 3 n a P{ + d k fl a ) , (42) 

Art = -P\An k , (43) 
An j = _ F i An k ; ( 44 ) 



where 



iskk 



dfn a (Pi) 2 + dp a {p{) 2 + d 2 k n a + 2d i d j n Q p i k p{ 



-2did k n a p% - 2d 3 d k n a PH . (45) 

The change in satisfaction is given by, 

A M n a « X -Kf (-d£i a p\ - d 3 n a p{ + d k n a ) 2 . (46) 

Production is assumed to be an irreversible process and so, it can only take place iff 
-dittaPi - djn a P j k + d k Q a > and K kk > 0. 
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Proof: The rate of change in satisfaction is given by, 

-jL(A M n a ) = -d^ a p\ - d 3 n a p{ + d k n a . (47) 

In order for the agent to produce k, it must be able to increase it's satisfaction and so 
we need d(Aj^Q, a ) / dn k > 0. As the agent keeps producing k and depleting i and j, 
it will make at least one of the derivatives <9jfi a or dj£l a very large and positive. This 
follows from the convexity of the index of satisfaction. Thus there is a point where the 
derivative (|47p will change sign. This represents the equilibrium point. 

Following the general spirit of a near-equilibrium expansion, we assume that the 
agent is close to that equilibrium point. Integrating Eq. (f4"T|) and expanding around 
An k = we get, 



A M n a « An k i^-diQaPi - djn a P 3 k + d k Fi 



An k =0 

%n a {p\y + dp a (p\f + d 2 k n a + 2d i d j si a p i k p{ 
2did k n a Pi - 2d 3 d k n a p{] +... (48) 



An k =0 



It is easy to see that the maximization equation 

d 



A M n a = , (49) 



dAn k 

gives Eq. (|42p . Moreover, inserting (|42p in (|48p we get the change in satisfaction (|46p . 
□ 

One can also consider a simpler process such as i — » k. The resulting equations can 

k 



be obtained from the proposition above by setting P{, = 0. 



4.4 Price Setting by a Market Maker 

Another economic operation that we will consider is the case where there is a special 
agent (Market Maker) which sets prices according to excess demand. This agent can 
interact at every time step with a different number of agents. This is different from 
the bartering process. In the later, two agents negotiate a price. The Market Maker, 
however, satisfy the excess demand of his customers, but has the privilege of setting 
the stock prices. For simplicity, we will assume that the Market Maker is a wealth 
maximizer. One then can prove the following proposition: 

Proposition 4 : Let M n = M 3 i the exchange rate between products i and j at time 
step n. Then, the Market Maker will adjust the exchange rate at every time step as, 

where the sums go over all agents interacting with the Market Maker, and all quantities 
in the RHS are evaluated at time step n — 1 . 



16 



Proof: The excess demand for product i from the buyers/sellers at price M n can be 
found from proposition 1, 

D(M n ) = An*, » Y, J * ~ M ndj^a) ■ (51) 

a a 

Therefore, the satisfaction of the Market Maker (MM) changes by, 

AOmm = ^mmK mm - D(M n ),n J MM + M n D{M n )) - ^("mm, n J MM ) . (52) 

We assume that the excess demand is not big enough to deplete the MM inventory. 
This needs to be checked at every time steps in the simulations. 
The MM now maximizes his satisfaction w.r.t. M n : 

° Aft M M = 0. (53) 



dM n 

This equation can be written as, 

-l^ + ^L + Mn= 0. (54) 
djiluM D'(M n ) 

Since the MM is a profit maximizer, his utility has the form, 

UuM ~ log flM M M M M + n MM + • • ■ > ( 55 ) 

where Mmm is the "model" that the MM has of the price. Thus, 

diUuM 



djUyiM 



Mum ■ (56) 



We now assume that the MM expectation is such that E[Mmm] = Af n _i where M n _i 
is the last closing price. Moreover, the MM predicts zero variance: Var[MMM] = 0. 
Thus, 

dj Omm 

It is then easy to see that Eq. (f53| reduces to Eq. (f50j) of the proposition. 

We can now easily check that the MM indeed makes a profit, regardless of the sign 
of the excess demand. The wealth of the MM at time n — 1 is (measured in units of j), 
W n -i = (n^ M M n _i + n J MM + ...). At time n, we have W n = (K MM - D(M n )]M n ^ + 
I n MM + M n D(M n )] + ...). Thus, the change in wealth is, 

AW = W n - W n ^ = D(M n )(M n - Af n _i) = }^ M j^f> > ■ ( 58 ) 

□ 

This model of a Market Maker is very similar to other models in the literature |10j 
which assume a linear relation between the price adjustment and excess demand. Here, 
however, we give a precise microeconomic derivation. 
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4.5 What-by-What Matrices and Information 

In the previous sections we have presented the four basic economic operators: an ex- 
change at a fixed rate (7i), an exchange trough a barter process (^2), a production 
process (M) and a centralized Market Maker who sets prices according to excess de- 
mand. We have given "flow" equations describing how much stuff is traded/produced 
based on the maximization of satisfaction near equilibrium. Moreover, we have formu- 
las for the change of satisfaction for fixed information. 

However, once a trade is performed, one has new information about the system: 
there is an exchange rate —An 1 / Art . How do agents process such information? Recall 
that agents carry models of the exchange rates, {M a ) 1 -. A trading process produces a 
new data point which can be fed into such model. As we assumed in section 2, agents 
have enough rationality to maintain a consisten w-w matrix. Given a trade with only 
two products, say i and j, there is no unique way of updating all entries of the w-w 
matrix. Here we propose a simple formula to do this. 

For the operation 7~i we propose that agents update their w-w matrix ag^, 

fx: (Mj^^, Vi.jeP, (59) 

where we evaluate at the point An 1 = An 3 = (that is, before the actual trade). 
For the barter operation 1~2 we propose a similar form, 

%■■ (M a Yj = {Mpfj = , (60) 

where we evaluate at the point An 1 = An 3 = (that is, before the actual trade), and 
= Via + Note that in a barter both agents must agree on the final exchange 
rate and thus {M a ) 1 - = {Mp) % -. Finally we see that the definition ([60]) coincides with 
the actual exchange rate computed within the linear approximation, Eq. (|3ip . The 
conditions (|59|) and (|60|) can be relaxed in more general models. 



5 Simulations of Decentralized Markets 

In this section we consider some numerical simulations of simple decentralized market 
models. In these models, agents are paired at random. Such structure is known in 
the literature as "search equilibrium" |23] [25"1 I26j . However, we emphasize that we 
are working out of equilibrium. Once two agents find each other they trade trough a 
Barter operation (T2). However, they can choose which trade to make such that they 
obtain the most mutual satisfaction according to Eq. ([51]) . In other words, they get 
to choose which pair of products to trade at every time step. Since every agent can be 
paired with any other, we see that the we have a complete network. 

7 Note that this is an update of a new data point to the model of M a . 
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We start in subsection 5.1 with an example of a decentralized market with only two 
products and no production. We show how there is price discovery and explain the 
properties of the relaxation to equilibrium. Using a simple mean-field theory analysis 
we estimate the relaxation time. In section 5.2 and 5.3, we add the simple transfor- 
mations i — > j and j — > i. We find that the system can self-organizes into periodic 
price cycles with price convergence, or remain in a disordered steady-state where agents 
never converge to an equilibrium price. 

In section 5.4 we address the interesting question of the emergence of (commodity) 
money. We consider the case of three products i, j and k but now with a simple 
transformation i — > j and j — > i. In this case, k is not being transformed and so it can 
only be traded. We find that for certain initial conditions, the system self-organizes 
into periodic price cycles. Moreover, the system can self-organize into a phase where 
all agents use k as a currency. In other words, all trades involve either i <-» k or j <-» k 
but not i *-* j. However we find that such phase is unstable. 

Using a mean field theory analysis, we give a purely statistical explanation for the 
emergence of money. We find that, quite generically, the product which becomes the 
currency must be distributed among the population with the greatest variance, and 
the smallest covariance with relation to the other products. 

5.1 Two Products and the Convergence to Equilibrium 

In this section we study the simplest economic model satisfying the properties of section 
2. The model has N agents and two products which we call i and j. The utility has 
the form 

u a = log [(<r + [(M Q r/«)i . (6i) 

We assume that the agents' expectations for the price for the next time step is the 
same price that they found in the previous time step. That is, E[(M Q ,)* J | t+ i] = (M a ) l j\ t , 
where {M a ) l j\t is the price found trough the bartering process in the previous time 
step. We further assume that the agents are completely certain about their prediction 
so that Var[(M a ) l -|t + i] = 0. Therefore, it follows that fl a = U a . Let us now describe 
the algorithm. 

Model #1: 

1. Agents start with some (random) inventory n l a and n„ and price {M a ) 1 - 

2. At every time step, agents are paired at random (we take an even number of 
agents) . 

3. Every pair of agents (a, (3) decides which trade (7^) to perform according to which 
gives them the larger satisfaction in Eq. (|34p . They perform their favourite trade 
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and update their inventories as, 
n a n a + > n a ~^ n i + An j , njg -» - An 1 , n^^n^- An j , (62) 

where An 1 and An 3 is given in Eqs. (|30p and (|31 1) with the utility given in Eq. 
(|6ip above. Note that all derivatives are taken before updating the inventory and 
the price. They also update their prices using Eq. (fBTJj) . 

4. The process is iterated from step 2. 

In figure 1 we show a typical result of such simulation. For the simulation we used 
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Figure 1: Relaxation to equilibrium with two products and no production. The yellow dashed line 
is the mean field theory result. 

N = 100 agents. We took the exponent of the utility to be v = 1/2. The initial 
inventories were taken from a uniform random distribution in the intervals: n l a E [1,2], 
n J a £ [4, 5] . Note that the system is scale invariant and so the overall order of magnitude 
of the inventories is irrelevant. The initial prices were taken from a uniform random 
distribution in the interval {M a ) 1 - € [1, 1.1]. Figure 1 shows the prices (M Q ) ^ of every 
agent in different colors. We see the convergence towards a fundamental price. The 
horizontal line is the fundamental price which, by scale invariance and the form of the 
utilities, is simply {M) 1 - = n l jn 3 , where n l and n J are the total number of products i 
and j in the economy. 

We can get a better understanding of the relaxation to equilibrium by doing a mean 
field theory analysis of the pricing formula ([60j) . Let {Ma) 1 - = M a and let the brakets 
( • ) denote averages over the population. Then we expand, 

ni = (n*) + <5< , < = (n j ) + 5n{ , M a = (M) + 5M a , (63) 

for all a € TV. 
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To leading order Eq. (|60p gives us the average price at time t in terms of the price 
at t - 1: 

(Aft) « (Mt-i) 1 ' (jjj) , (64) 

Here we used the fact that since the product number is conserved the average product 
numbers are constant in time and that {n l ) / {n 3 ) = n l /n J . One can easily iterate this 
equation to obtain, 

(M t ) = (M f . (65) 

We see that as t — > oo the price (M) goes to the fundamental one ri 1 /n 3 . We can define 
the relaxation time for such process by v t = e~'/ r , and we find 

1 



. (66) 
log v 

We see that for small v the relaxation time is small and so equilibrium is reached 
quickly. For v — > 1 the relaxation time becomes infinite and the system takes longer to 
equilibrate. In fact, the price formula (|65p fits the numerical data quite well as shown 
in figure 1. 

Another view of the relaxation time can be obtained using the flow equation (|30p . 
Doing a similar mean field theory analysis we find, 

(M)'vy- 1 



An 1 



v(M) v ~ l {n i )(n 3 ) u 



uy {{n^Snip - (n 3 )5n 3 c 

5M aP , (67) 



2{v-l){{n i ) v + {My{niy 

where 

Sn\p = Sni - bn^ , 5n J af3 = Sn{ - Sn^ , 5M af3 = 6M a - 5M P 

The first term in Eq. (|67p gives the linear response to gradients in product number. 
The second term is the linear response due to price gradients. We see that as v — » 0, 
the first term dominates and the system is very sensitive to inventory gradients. This 
is why the relaxation time is smaller. For u — > 1, the second term dominates. This 
means that agents are very sensitive to price movements, and hence are less sensitive 
to the distribution of products. We should also note that the limit v — * 1 is singular 
and so our linearized approximations break down. 

A third way to look into the equilibrium state of the system is through the product 
distribution. The utility maximization implies, 

dn a = =^ ditta - (MaYjdjQa = . (69) 



Using the utility Eq. (|6ip and the fact that O a = U a in this model, we get that in 
equilibrium, the inventory must be constrained such that 

(M„)W = < . (70) 
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If the agents have roughly agreed on a price we get 

(M)< = < . (71) 

Therefore, we see that at equilibrium, agents' product numbers should lie in this line. 
Figure 2 shows a scatter plot of agents inventories in the (n l ,n J ) plane, and the equi- 
librium line [M)n 3 a — r^ a = 0. The plot was taken at time step t = 50 for the simulation 
of fig. 1 (v = 1/2). We see that indeed agents have reached equilibrium. 
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Figure 2: Equilibrium distribution of goods. 

5.2 Production, Price Cycles and Self-Organization 

We can now implement some production processes in our two product example. For 
this simple market there are only two possibilities: i — > j and j — > i. We can specialize 
the results of proposition 3 to this simpler production operation. For the process 
we just take P\ = P*- and P° k = 0. Similarly, for j — > i, we take P ] k = P^ and P\ = 0. 
The algorithm will be the same as the previous one, except that at every time step, 
we allow the agents to choose which production process to do before doing a trade. 
That is, all agents have the same "skills". They choose which process to perform 
according to which one gives them the best satisfaction, which can be computed from 
Eq. (I46p . Then they update their inventories according to Eqs. (|43p and (|44j) (with 
the appropriate indices). If both processes decrease their utility they choose not to 
produce. 

We note that for P l - > 1 and P\ > 1, the output of each process will decrease the 
total number of products. Therefore, these operations will tend to decrease the utility 
and therefore will not be used by the agents. Now, for P % - < 1 and P\ < 1, the total 
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number of products is increased. For example, for P l - = 1/2, we have a transformation 
lj - 2i. 

In order to illustrate the self-organization of the system, we take a system with 
N = 10 agents and v = 1/2. Moreover, we take the initial inventory of all agents to 
be the same: n l a = n a = 1 Va E Af. However, in order to start the dynamics we take 
the initial w-w matrix from a uniform distribution in the interval {Ma) 1 - E [0.8,1.2]. 
Finally, the production rates are taken to be = P\ = 1/2. 

In figure 3 we show the result of this simulation for the w-w matrix of all agents. 
We see that the system goes first trough a disordered phase but at some point it 
converges to a cyclical equilibrium state. The red dashed line is the fundamental price 
M l j = n l /n J . Note that due to the finite relaxation time, the agents are not completely 
converging to this price. Nevertheless, they do agree on a price between each other. One 
can show that the reason for the price cycles is that agents are twitching collectively 
between the two types of productions. 
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Figure 3: Self-organization of a two product system. The agents are performing the metabolic 
process i — > j and j — ► i. The red-dashed line is the equilibrium price M l - = n l /n J . 

Another important point is that the total number of products in the economy is 
growing exponentially in time. For example, in figure 4 we plot the log of the total 
number of product i as a function of time. 

5.3 Not Equilibrium, but a Steady- State 

So far we have seen cases where the agents collectively find an equilibrium price, even 
when it is time dependent. However, this is a rather special situation. More generally, 
the system never quite reaches an equilibrium. Rather, one can say that the system 
is in a steady-state. In such a state, the prices might not converge towards a unique 
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Figure 4: Log of the total number of product i in the economy. 

equilibrium, but oscillate around it. Moreover, agents do not quite agree on the prices. 
In this section we show an example of such behavior. 

The model is similar to the one of the previous section. However, instead of letting 
the agents decide which production process they do, we assign them fixed skills. That 
is, they have the ability to do either i — > j or j — > i, but not both. We distribute the 
skills randomly among the agents. In figure 5 we show a typical run of such system. 
We have taken N = 100 agents, v = 1/2 and P- = Pf = 0.9. For the initial conditions 
we have, n l a = n J a = 1 and (M a ) l j € [1, 1.1]. We note that the prices never quite reach 
an equilibrium. 

In figure 6 we show the average of logM^, along with log(n J /n J ), which is the 
"equilibrium" price. We note that both are systematically away from each other. This 
shows that the system is truly in a non-equilibrium state. 

5.4 The Emergence of Money 

In this section we study the emergence of (commodity) money in a simple system 
with three product and production. We want to emphasize that the "currency" that 
we will see emerging correspond to commodity money as it is an object that give 
agents satisfaction. This should be contrasted with "fiat" money which is intrinsically 
worthless to the agents. There is a large body of literature regarding the emergence 
of money. In the classic paper [23], Kiyotaki and Wright (KW) study a simple general 
equilibrium model with three goods and N agents that could produce one of three kind 
of products and consume one of them (which is different from the one they produce). 
The agents find each other at random and have very simple strategies of "trade or 
not-trade". The model also included the cost of storing for the different products. 
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Figure 5: Disordered steady-state of a two product system. The agents are performing the 
metabolic process i — > j and j — » i, but now with assigned skills. The red-dashed line is the 
equilibrium price M l - = n % /n 3 . 



The authors found Nash equilibria where either commodity or fiat money serving as 
the medium of exchange. This kind of general equilibrium models where agents find 
each other at random is usually known as "search equilibria". There have been many 
subsequent works following the KW model, see e.g. [251 [26]. For an interesting previous 
attempt to explain the emergence of money see [24J. 

Even though these models are interesting in that they show the existence of Nash 
equilibria with commodity or fiat money as a medium of exchange, they do not pro- 
vide a explanation on how such transition could take place from a primitive barter 
economy. An attempt to explain the transition from a barter to a fiat money economy 
was developed in [27]. The transition is explained still in the framework of general 
equilibrium theory by introducing a centralized government agent which "must be able 
to promise credibly to limit the issue of money" . This approach has been criticized by 
Selgin [28] which claims that there is no known direct transition from barter to fiat 
money in history. Instead, it seems that fiat money is a rather recent development and 
that it has always followed an existing commodity money standard (or that the fiat 
money was convertible to some commodity such as gold). 

In order to see a dynamical transition from barter to commodity money, one needs 
to go beyond equilibrium theory. The author is not aware of any non-equilibrium 
model that shows this transition. However, we should mention the models of [29\ [30] 
which show that the price of fiat money can be determined dynamically. One important 
reason to have a non-equilibrium theory with a monetary phase transition, is to address 
the question of monetary stability [3H [32] . 
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Figure 6: Comparison between the average log price M*- (blue) and the "fundamental one" M\ 
n l jv? (red) for the disordered steady-state of figure 5. 



In fact, we will find that in our first example the monetary phase is unstable. 
Before describing the simulations, we want to make a mean field theory analysis of the 
bartering process described in proposition 2. Suppose two agents find each other, and 
must decide which products to trade. In the near-equilibrium approximation, both 
agents will gain the same satisfaction as we showed in proposition 2. Thus, they will 
be able to unambiguously decide which pair to trade according to Eq. (|34p. Let us 
now suppose that all agents have reached, more or less, an agreement on the exchange 
rate of products. In fact, they can disagree on the prices, but we will need to assume 
that such disagreement is much less than the inventory fluctuations. In equations, 



SM 5n 



(72) 

(n), etc. are 



where the brackets indicate averages over the population, and 5n = n 
the fluctuations. 

We can now expand the gain in satisfaction, Eq. (|34h . for a trade of i and j between 
agents a and (3 around the averages. To leading order, we get 



An, 



1/(1 - v) ((n^in^M) 



8 ((nr + (M^ni))" )Ek(Mi(n k )) 




5ni Sn 



8 + H 



(nj) (n l ) (nj) 



(73) 



We remind the reader that we are assuming utility functions of the form (|16p . 

We see that the terms with the averages on the RHS of Eq. (|73p will not vary much 
according to which product the agents trade. The terms in the parenthesis are the ones 
which give the largest fluctuations. These last terms will determine what products the 
two agents will decide to trade. We can now take an average over the whole population 
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and get 



(Afiy) ~ ((x* - x j ) 2 ) = Varfc*) + Var(x j ) - 2Cov(x\x i ) . 



(74) 



where we have defined the variables 




(75) 



For a product to become the favorite medium of exchange, it will need to maximize 
([71]) , This can happen in various ways. From Eq. ([71]) we see that such product (call 



means that such product should be distributed pretty much independently from the 
other products. Now let us see how can this happen in some numerical simulations. 

Lets begin by studying a barter economy with three products i, j and k and the 
transformations the transformations i — > j and j — > i. That is, the model is just like 
the one we studied in section 5.2, but now with an extra product k that does not 
gets transformed. So what would be the signature of a monetary phase? We say that 
the system is in a monetary phase with currency k if all (or most) agents make the 
trades i <-> k and j <-> k but not i *-+ j. Note that the existence of this phase must be 
due to the dynamics of the system as the agent utilities are invariant under changes 
of inventory measure. In other words, all products are treated in equal footing in a 
trading process. 

We have found that, in this model, the monetary phase only exist for some relatively 
fine tuned initial conditions. As an example, we take N = 100 agents with v = 0.1. We 
also take the rate of production to be close to one: P l j = P\ = 0.95. This means that 
the total number of i and j will grow slowly. Initially, we give every agent the same 
amount of stuff: n % a = n? a = 1. Finally, we take our initial w-w matrix from a uniform 
random distribution in the interval (M a )*- € [1,1.01] and (M a ) l k € [1,1.01]. Figure 
7 shows the (M a ) l j entry of the w-w matrix for the first 20 time steps. All agents' 
are plotted in the same figure, but their agreement is so good that they are hard to 
distinguish. The dashed red line is the fundamental price M l - = ri 1 /n J . 

The price cycles are what we expected from the previous simulations. Now comes 
the surprising part. In figure 8 we plot the fraction of agents using product A: in a 
trade. We see that for the first 60 time steps, more than 95% of all agents are using k 
in a trade. This is the monetary phase! However, what is surprising that after t ~ 70, 
the agents cease to use A; as a currency. That is, they are bartering with all possible 
combinations. We have plotted the line 2/3 since this is the fraction of agents we 
expect to use k in a trade if the trades are being chosen at random. We don't observe 
any particular movement in the prices that coincides with the end of the monetary 
phase. 

We now want to understand the existence and stability of the monetary phase 
using the mean field theory analysis described above. First, we note that ignoring 



it i') must have the greatest variance (Var(x 4 ) S> Var(x l ), Vi ^ i') and/or the smallest 
covariance with the rest of the products (Cov(x i ',x*) ~ 0, \/i 7^ i 1 ). This last condition 



27 







5 



10 



15 



20 



Time 



Figure 7: Log of the relative exchange rate of i and j for an economy with three products i, j, k, 
and the production processes i — > j and j — ► 1 

the price discrepancies between agents is a very good approximation in this case. In 
figure 9 we plot log {{x l — x J ) 2 ) for the different pairs of products. In the plot, we have 
only shown a time interval around the end of the currency phase, to make it more 
clear. First, we can see that the monetary phase is not an equilibrium as the variances 
are changing over time. Furthermore, we see that during this phase ((x l — x k ) 2 ) ~ 
((xi — x k ) 2 ) > ((x 1 — x^) 2 ). This is what we expect from the mean field theory analysis. 
However, once the product variances stabilize (a true "equilibrium"), we find that 
((x l — x k ) 2 ) « ((x J — x k ) 2 ) rj {{x l — a/ 7 ) 2 ), and so no trade pair is preferred over the 
others. This is the end of the monetary phase. 

The example above is interesting in that the monetary phase arises "spontaneously" 
from the intrinsic dynamics of the system. However, this is not the only example where 
agents choose a preferred medium of exchange. In fact, according to the mean field 
theory analysis, all we need to have is a product with larger variance and smaller 
covariance than the rest. We can make this happen "artificially" by endowing agents 
with a particular product at every time step. As an example, we study the same model 
as above, but without production. However, we assume that the amount of product k 
that different agents have varies according to, 



where t is the time step, and we take r from a uniform distribution with zero meaio 
Therefore, the total amount of product k will not change on average. 

In figure 10 we show the fraction of agents bartering with product k. We see the 
roughly 90% use k in an exchange. In figure 11 we plot log ((x l — x^) 2 ) for the different 

Note that we take the return r from the same distribution at every time step. 



n k a {t) 



n k a (t-l)(l+r) 
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Figure 8: Fraction of agents using k in a trade. The monetary phase is the plateau around the 
interval t € [0, 60]. Note that during this phase more than 95% of the agents are using k in a trade. 

pairs of products. We see that indeed the trades i <-> k and j *-* k are preferred over 
i <-» j. This makes k the favorite medium of exchange. In this simulation, the agents 
do not completely agree on the prices. In figure 12 we plot the variances of the M % - 
and M\ entry of the w-w matrix. We see that they do not go to zero. This is another 
example of a steady-state rather than an equilibrium. 

6 Simulations of a Centralized Market 

In proposition 4, we defined a centralized market with a Market Maker which sets 
prices according to excess demand. This structure is more appropriate in order to 
simulate financial markets. There is a large body of work on agent based simulations 
of financial markets (see the review [17] and references therein). One important line of 
research along these lines is the impact of agents' heterogeneity to stock price move- 
ments (see the recent papers [10] and the reviews [HI [E]). In fact, it has been 
claimed that some of the most salient stylized facts of financial time series such as, 
fat tails, volatility clustering, and decaying autocorrelations are, in fact, due to the 
heterogeneous strategies and expectations of the market participants. 

Our purpose in this section is not to provide new insights into these phenomena. 
Instead, we want to illustrate that the framework presented in this paper is very ap- 
propriate to study the effects of agents' heterogeneity. 

To this end we present some simple simulations of centralized markets. We begin 
in section 6.1 with the simplest model of homogeneous expectations, in order to see 
the expected convergence to equilibrium. In section 6.2 we consider a model where 
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Figure 9: Log of the averages ((x l — x^) 2 ) for each pair of products. The blue lines is for {(x l — x k ) 2 } 
and ((x J '— x k ) 2 ). The red line is for ((x % —x^) 2 ). We see that {(x % —x k ) 2 ) ({x^ — x k ) 2 ) > ({x 1 —x^) 2 ) 
in the monetary phase. So according to Eq. ([73]). agents prefer (on averge) to trade with k. The 
end of the monetary phase is the plateau after t ~ 80. 

agents make speculations about the price return of the next time step. We show the 
emergence of a speculative bubble and a subsequent crash. In all simulations we will 
use only two products for simplicity. Moreover the utility will be of the usual form, 
Eq. (|6ip . In the following we will use the notation M = M\. The basic algorithm for 
all the models is as follows, 

Model # 2: 

1. Agents are started with some random initial inventories and expectations on the 
next w-w matrix value. This step will be explained in more detail below. 

2. A new market closing price is computed from Eq. (|50p . We use a market maker 
with an infinite supply of products and so we do not have to worry about depleting 
his inventory. 

3. Agents update their inventories using 

< ^ < + A< , < -» < - M n A< , (77) 

where, 

A< = Jl (d { n a - MndjQa) , (78) 
and M n is the closing price. 

4. Agents update their beliefs for the next time step. 

5. The process is repeated from step 2. 
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Figure 10: Fraction of agents using A; in a trade. This is with no production, but with an exogenous 
endowment of k as described on the text. 



6.1 Homogeneous Expectations 

In the simplest model, agents will have homogeneous expectations about the next w-w 
matrix value. First, consider a fixed expectation, 



E[(M a ) n ] = M, 



n— 1 



(79) 



That is, agents agents believe that the next price is the same as the previous one. 
This is the model of rational expectations. Furthermore, we can assume for simplicity 
that agents are certain about this prediction and so Var[(M a ) ra ] = 0. Therefore, their 
satisfaction indices will be of the form, 



n a = E[U a ] = log [(<M n _i) 1/ + 



(80) 



In figure 13 we show the result of a simulation where agents have such and homo- 
geneous beliefs. We took ./V = 100 agents with v = 0.5, and the initial endowments 
where taken from a uniform distribution in the interval n % a S [1, 5] and n J a £ [1, 8]. The 
initial closing price was taken to be Mq = 1. We see that, as expected, agents reach 
an equilibrium which, by scale invariance, is M eq = nP /n\ Note that the total number 
of products is not conserved here since we assumed a market maker with an infinite 
supply 

We note that the w-w matrix is an internal valuation tool, and so it can be inter- 
preted as a "fundamental" price which comes from some exogenous information that 
the agent might have at hand. We should note that agents which hold a fixed belief 
about a stock price are usually called "fundamentalist" in the literature [10J. This is 
in order to distinguish them from the "chartist" which make a prediction based on a 
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previous price trend. Therefore, the model that we are considering here can be inter- 
preted as consisting of fundamentalist only. A popular way of modeling fundamentalist 
is to assume that they hold fixed beliefs about the price of a stock [10]. For example, 
our agents can have expectations based on some internal model such as the log-normal 
random walk: 



E[(M a ) n ] = (M Q ) n _! , (M a ) n = (M a ) n _!(l + r a ) 



(81) 



where the return r a is taken from a gaussian normal distribution with zero mean (at 
every time step). The index of satisfaction can now be approximated, to leading order 
in the variance of r a as, 

n a « \o g [{rt a {M a ) n ^y + {niy] 

v(ni{M a ) n ^y f«(M Q ) n _i)*' + (1 - v)(n, 



ex) 



(ni(M a ) n _i)" + 



cr a + ... 



(82) 



where a\ = Var[r a ]. It is usually assumed that the model (|8ip comes from some funda- 
mental information about the "company", which all agents have access to. Therefore, 
all agents will have the same model. 

In this case, one expects the market closing prices M n to follow closely the agents' 
model (|8ip . However, we need to remember that our agents might put more impor- 
tance to the actual distribution of products than to their w-w matrix. The parameter 
that controls the relative importance of their w-w matrix and their inventories is the 
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Figure 12: Log of variances of the w-w matrices. The red line is log(Var[M*-]) and the blue 
log(Var[M l fc ]). 

exponent v in the utility. For small v the agents will put more importance to the "fun- 
damental" price M = -n? /n l , than to their models. This will be important in triggering 
the market bubble in the next section. 

Here we illustrate this by running a simulation with N = 10 agent, where all agents 
have the same model ([81 p and they all have the same prediction for the return at every 
time step. We take v = 0.5 as an illustration. The initial distribution of goods is 
taken from the same uniform distribution as before. Moreover, we take the variance 
of the model ([81]) to be a a = 0.01. In figure 14 we show the closing prices along with 
the model prices and the "fundamental" equilibrium prices M = n 3 /n l . We see that 
the actual closing prices are half way between the model and the fundamental ones, 
as expected. If we take v = 0.9 instead, we see in figure 15 that the closing prices 
reasemble more the model price. If we want to see fat tails, volatility clustering, etc. 
we need to add some chartist strategies as in [ID]. We won't pursue this here. 

6.2 A Speculative Bubble 

In this section we present a simple example of a speculative bubble (see e.g. |33j). As 
we have seen the parameter v controls how much weight an agent puts in his own model 
of the market, versus the "fundamental" price which comes from the total number of 
goods in the economy. In the first model that we presented in the previous section the 
agents had the simplest prediction E[(M a ) n ] = M n _\. Thus, they took information 
from the market and incorporated it in their models. In the second example, they had 
fixed beliefs, E[(M a ) n ] = (M Q ) n _i, and so they where totally ignoring the market's 
closing prices. 
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Figure 13: Relaxation to the equilibrium price in a centralized market with homogeneous expec- 
tations. 

Here we want to construct a model that is in between these two. The agents' 
prediction will be of the form, 



where now r a is a speculation on what the log return should be in the next time step. 
We let all agents choose their own values of r a at every time step. For simplicity we 
assume that all agents are certain about their beliefs and so Var[(M a ) n ] = 0, and that 
all agents' beliefs r a are taken from the same gaussian distribution. 
The index of satisfaction is then, 



In figure 16 we show the results of a simulation with N = 500 agents, v = 0.5, and the 
initial inventory endowments are taken to be n' a = nit = 1. We also take the returns r a 
from a normal gaussian distribution with mean \i = 4 and standard deviation a = 2. 
At every time step we take r a from that distribution. Thus we see that agents are 
consistently betting on a positive return (on average). 

Figure 16 shows that at the beginning, the agents' speculation drive the market 
prices up. However, the fundamental price is falling so fast that the market price 
cannot keep with it. Eventually the bubble bursts and the market price is driven to 
zero. 

The existence of the bubble lies in the fact that agent pay attention to both their 
inventories and their beliefs. If we take a larger value of v, say v = 0.9, agents will put 
more weight to their beliefs than to their inventories, and they can even turn around 
the fundamental price as shown in figure 17. 



E[{M a ) n ] = M„_ ie 



(83) 




(84) 
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Figure 14: Closing prices for a market where all agents are "fundamentalist" whose internal price 
is given by the random walk of Eq. (|8ip . The red line is closing price. The blue line is fundamental 
equilibrium price M = n 3 /ri 1 , and green the agents' model. This is for a model with v = 0.5. 

7 Conclusions 

In this article we have studied a class of heterogeneous economic agent-based models 
which are built upon some basic set of principles, and a set of fundamental operations 
which include trade and product transformations. The agents have very limited infor- 
mation on the system, and have only a finite set of operations that they can perform. 
Therefore, they have bounded rationality. One of the key assumptions was the principle 
of scale invariance. That is, that there is no other scale in the economy apart from the 
units that agents use to measure the products, and the dynamics of the economy must 
be invariant under unit transformations. Moreover, all prices are relational. These 
assumptions are based on the idea that economic systems have approximate (or exact) 
gauge symmetries which restrict their possible dynamics. 

We also introduced the concept of a "near-equilibrium" expansion. We argued 
that this is the analog of "perturbation theory" , which is a very familiar technique in 
physics. The near-equilibrium approximation allow us to derive approximate "flow" 
equations that describe how many products agents exchange in a trade, and produce 
in a metabolic process. These equations are written for a general convex index of 
satisfaction. These equations can be applied to a wide variety of market models as we 
showed in the text. 

An interesting point that we studied was the (possible) convergence towards a global 
economic equilibrium. In section 5.1 we saw that this can indeed happen. Moreover, we 
calculated the relaxation time to equilibrium in a particular model with two products. 
However, as we pointed out in section 5.3, one can also have steady states where the 
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Figure 15: Closing prices for a market where all agents are "fundamentalist" whose internal price 
is given by the random walk of Eq. (|81|) . The red line is closing price. The blue line is fundamental 
equilibrium price M = n 3 /n l , and green the agents' model. This is for a model with v = 0.9. 

agents never quite reach a price equilibrium. 

Another interesting aspect of these models is that they can show a spontaneous 
transition to a monetary economy. We studied this point in section 5.4. There, we 
showed that the monetary phase can be explained from a mean field theory analysis, 
in terms of the distribution of goods. Finally, in section 6 we showed that one can 
also address the question of stock markets and agents' expectations within our class of 
models. 

The models presented in this article can be extended in variety of ways. First of 
all, one would like to develop a more systematic treatment of the near-equilibrium 
expansion. In particular, one would like to have a way of analytically studying the 
stability of certain economic equilibria and calculating relaxation times. Moreover, one 
would like to do this for different network topologies. It turns out, that the natural 
language to study such questions is that of Markov Chains and Graph Theory. This is 
currently work in progress [M]. See also [35] for a review on networks in economics. 

Another important question to address is the role of contracts and credit. These 
must be added to any realistic model of the economy. Contracts require us to go 
beyond anonymous agents. This is a difficult topic to deal within agent-based models. 
Nevertheless, it is possible to introduce contracts into our class of models. This is also 
work in progress. 

Finally, there is the question of innovations. That is, new products come into 
existence quite frequently in a real economy. This question has recently be addressed 
in [36]. The authors studied an economy of wealth maximizing agents. The agents 
were endowed with metabolic processes like the ones we have studied here. Moreover, 
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Figure 16: A speculative bubble. The red line is the actual market closing price. The blue curve 
is the "fundamental" price M\ = n 3 /n l . This simulation is for v = 0.5. 

new products can pop into existence. In their economy, though, all agents agree on 
a price and they could only trade using a prescribed money. Therefore, it would be 
interesting to extend the work of [36] using our scale invariant approach. 

The author believes that the ultimate goal of any non-equilibrium approach to 
economics, is to ultimately provide a prediction for certain statistical laws that can 
be matched with econometric data. These "laws" might involve relations between the 
distribution of prices and the underlying products, as an example. The semi-analytical 
modeling approach presented here is amenable to this kind of prediction. However, 
more realistic market models must be studied. 
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Figure 17: Agent's beliefs can turn around the fundamental price. The red curve is the market 
closing price, and the blue one is the "fundamental" price M\ = n J /ri 1 . Here we took v = 0.9. 
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